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If  .  •  ,t  '  .  t  ion  of  't  •  i;  ap 

of  several  subgroups,  jult  -  ‘i.-roup  witl»  It e  own  un- ' r- 
lying  distribution,  and  the  .  cveral  subgroup-  nixed  together 
according  to  certain  pr&portioi?., ,  ue  ^ould  Lave  an  instance 
of  a  mixture  of  distributions;  i.e. ,  the  underlying  distri¬ 
bution  for  the  entire  population  would  be  a  i fixture  of  the 
distributions  for  each  subgroup. 

A  study  is  made  of  the  more  recent  developments  in  the 
theory  of  fixtures  of  distributions.  The  oroblem  of 
ident if lability  in  mixtures  is  considered  in  so  te  detail. 

The  special  cases  of  linear  mixtures  and  the  distribution 
of  sums  of  independent  random  variables  are  also  considered. 
Finally,  the  problems  encountered  in  estimation  ox  para  leters 
in  mixtures  are  discussed. 
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1.  Introduction. 

There  exists  a  cat..-.  Ids  i'b'?':-;  body  of  literature  relative 
to  the  theory  of  mixtures  of  robability  distributions,  and 
several  results  have  been  published  relating  to  the  statis¬ 
tical  estimation  of  parameters  when  the  underlying  distribu¬ 
tion  has  been  assumed  to  be  a  fixture  of  distributions. 

There  seems  to  be  a  growing  Interest  in  this  problem,  and 
one  is  certainly  justified  in  studying  it  in  its  general  form 
inasmuch  as  the  general  theory  includes  as  a  special  case  the 
classical  statistical  assumption  of  a  single  underlying  dis¬ 
tribution  function  for  the  population  under  study. 

By  way  of  introduction,  we  will  consider  some  specific 
examples  to  show  how  mixtures  of  distributions  come  up  quite 
naturally  in  statistical  investigations. 

Historically,  the  problem  seems  to  have  been  studied 
first  by  Karl  Pearson  about  1894  [g]  .  "J  He  noticed  that  data 
(measurements)  taken  on  various  collections  of  biological 
specimens  did  not  a^ree  too  well  with  the  Gaussian  distribu¬ 
tion  when  plotted  in  histogram  form.  It  was  quite  apparent 
in  many  instances  that  a  definite  bimodality  existed  where 
one  would  have  expected  unimodality.  Pearson  postulated  that 
the  underlying  density  function  was  of  the  following  form 

lumbers  in  square  brackets  refer  to  bibliography. 
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and  He  tried  to  estimate  the  para  ieters  c*,  ^"i*  an<^ 

0~2  using  the  method  of  moments.  He  was  led  to  an  equation 
of  ninth  degree  and  had  considerable  difficulty  calculating 
the  roots  of  the  polynomial.  Pearson  called  this  a  problem 
of  "dissection."  His  aim  was  to  "dissect"  the  mixture  of 
these  two  normal  density  functions  into  its  components  and 
then  try  to  infer  what  could  have  caused  such  a  mixture. 

As  a  second  example  of  mixtures  of  distributions,  we 
draw  on  a  familiar  problem  in  life  testing  or  reliability 
theory.  It  has  been  observed  that  in  life  tests  of  electron 
tubes  the  initial  failure  rate  is  relatively  high  and 
decreases  as  the  population  under  test  ages.  In  general, 
the  failure  rate  becomes  constant  for  a  time  and  then 
increases  with  age.  Such  a  behavior  suggests  that  the  popu¬ 
lation  might  be  a  mixture  of  several  subpopulations  and  that 
the  underlying  distribution  function  might  be  a  linear  sum 
of  several  distribution  functions. 

Of  further  interest  in  devices  such  as  electron  tubes  is 
the  phenomenon  that  devices  fail  for  different  reasons  and 
such  a  population  of  elements  could  be  classified  according 
to  cause  of  failure.  Then,  assuming  the  underlying  popula¬ 
tion  is  composed  of  such  a  mixture,  one  might  try  to  estimate, 
from  a  sample  of  failures  classed  as  to  cause  of  failure,  the 
proportion  which  will  fail  due  to  each  cause  in  order  to 
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deter.. Lire  1  1  -c-m  ^  o  i  cch  effort  in  improving  the 


device 


In  stati-Gtlc  i  deci  sion  theory,  as  developed  by  .laid, 
we  find,  for  e  v./)le,  in  the  case  of  a  stochastic  process 
where  the  random  \.  riables  are  assumed  to  be  identically 
and  independently  distributed  according  to  J?'(x;0),  that  © 
is  also  assumed  to  be  a  random  variable  with  its  own  prob¬ 
ability  law  G (6 ) .  Under  this  assumption,  the  random  var¬ 
iables  are  in  reality  assumed  to  be  distributed  according  to 


A  special  case  of  the  mixture  problem  may  be  viewed  as 
follows:  suppose  we  assume  that  the  population  unde?  inves¬ 

tigation  has  an  underlying  distribution  of  known  form  F(x;0) 
and  that  the  parameter  is  also  a  random  variable  with  distri¬ 
bution  G ( 0 ) .  If  we  further  postulate  that  G(0O)  =  Pr[©=e0]=l, 
then  the  underlying  distribution  is 


hhat  we  have  done  here  is  tantamount  to  assuming  that  the 
underlying  distribution  is  of  a  specified  form,  with  ©  a 
fixed  value  not  sub.’ect  to  variation  (in  a  probabilistic 
sense),  and  t  i  ounts  to  assuming  t  at  the  distribution 
is,  say,  normal  ith  lean  //Q  and  standard  deviation  CT0 ,  or 
exponential  with  uarameter  0O. 

In  this  paper  we  pro  ose  to  discuss  the  theory  of  mix¬ 
tures  of  distributior  from  a  far  less  general  point  of  view 
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tl  .  I  2  jo  t  o  '  f  :  ■  r  .  1 1  U  lustr  •••-  t 

tYz  I  t:  -TV  3  ~t-  useful  r.':;ult3.  te 

t  '  oo r  • '  =*!’  t  *•  >roM  r  oh  >  <r  t 1  "i  -  V-.;  litv  d  usin«  some 

of  t1  *  r»  suit  *  bi  tt  is  !nt  ;;  iu.;  'Oeciftcally  -rihioh  of 

the  it  /  hr1  distribution*  *rc  i  ‘a  •  tifiable.  he  then 

looh  <kt  4  ~  cial  of  rnihir.  6  tributions  and  determine 

some  a.1  braic  rro  parties  of  tie  i  t  .-nr  d  class  of  mixtures. 

A  rejj..  '  analogous  to  the  classic  j.1  r'  orodictive  property 
of  certain  distributions  is  presented  for  a  certain  class 
of  mixtures  in  Beet  Ion  7.  he  then  tale  up  the  problem  of 
estimation  of  para  net ers  in  fixtures  o^  istribut ions . 

2.  Theory. 

By  way  of  otation  we  let  <^»  =  j?(  x ;  at)  :  o(  i.  E1'  |  denote 
a  family  of  ono-d  l«fe:isior:al  distribution  functions  indexed 
by  a  real  m— dimensional  vector  o}.,  where  Sul  denotes  Buclidean 
m-space.  Althou  *  this  1  - v  - !•-  :.n  .t  i  •  restricted  to  one- 
dimensional  distribution  functions,  tne  extension  to 
n-dimensional  istribut ion  funct i - :s  nv  be  obtained  in  the 
usual  manner.  Let  .  be  a  point  in  2L  and  let  B  denote  the 


CT-field  of  Borel  sens  in  d1.  Define*  3-  =  j  :  i  :]  ...td  let 
//be  any  pro'bf  it  hire  -n  3.  Teen  t  o  hi  ction 

P(x)=  f*(Sx). 


is  t'  e  d  L?triblit  Loi  fu  cti  oerv*  *  me  3  5  -  to//.  3  on  -nr-sely, 

if  F(x)  i.  ■  .’.i  tribotion  f  i  scion  h*  E1,  ;  i-  i.  • 


*i  i 


r'  f4  Gj.  B  oj  g;  t  cat 


FU)  =  /^(  v  ) 


•  •  denote  •„  •  i  r-rnt  ion  o:  Lot»j sgue- 'it ielt 3 es  integration 

relative  to  *  -ui  .  //  by 


Hoe  ever ,  all  t.  •  results  that  follow  may  bo  a  with  inte¬ 
gration  in  the  Hiemaim-St  ielt  jes  sense  with  little  or  no 
modification  to  the  hypotheses  of  the  theorems. 

To  illustrate  this  notation,  we  might  consider  the 
fa  lily  of  exponential  distribution  functions  (d.f.’ai) 


<h  =  |f(x;  ol)  - 


1-expf-  o(  xj  :d>0  xiOj. 


In  this  case  d.  is  one-dii  ensional  and  restricted  to  c'-itive 
values.  3a ch  ''■clue  of  c*  determines  one  specific  d.f.  in  the 
family  a'r  d  consists  of  all  such  d.f.’s. 

Definition  1.  If  G  is  a  d.f.  defined  over  ,  then 


is  called  a  mixture  cf  the  family  =  \i?(x;oc){,  -id  ;ore 


specifically  a  G-jftixtnro  of  ^1  . 

Definition  2.  A  G-mixture  of  ,  say  H,  will  be  called 


identifiable  if,  for  any  d.f.  G*  we  have 


lutpliss  that  G=GV  . 


=  ^G  |  -of  jmifcir  r  i  3  tri buttons 

•-i-J  let  >  •  -  air.  _  ,  '.  j.x  s  oi  :  =  J  FdQ 

jt  3<  a  &  &  ,  '  ■.  ula  ceiled  sutifi- 

ar  .  if  ►  \n  r  r  H  :>j  ^  is  iu  .  .til  Ublo »  I'ue  mixing 

distri'  iti'-i  G  tii.y  be  either  li-cr.-te,  cont inuou*  or  a  com¬ 
bination  of  o..« h .  .  In  general,  tLe  case*  valor  are  useful  in 
statistics  §ire  t,  :m*3  !'}•  ne  G  is  either  out  irely  discrete  or 
continuous;  and  i».  what  follows,  we  have  tneie  cases  in  mind. 

definitions  1  and  2  rally  form  the  basis  cf  this  dis¬ 
cussion  iu.s.iuch  they  delineate  the  two  ^ antral  areas  of 
interest  in  tije  t  leory  of  mixtures  of  distributions#  From 
the  mathematics 1-probn bill  tic  point  of  view,  properties  of 
the  mixtures  Ii  are  studied  when  special  properties  are 
attributed  to  the  class  fa  or  the  class  of  mixing  distribu¬ 
tions  &  ,  or  both.  The  question  of  ideat if lability  must  be 
answered  before  meaningful  statements  (statistical)  can  be 
made  relative  to  the  parameter  °L .  Proofs  of  ti  e  results 
cited  in  what  folloVu  mar  be  found  in  tie  indicated  ref¬ 
erences.  Proofs  will  be  given  .  i#n  it  is  thought  useful 
and  in  those  cases  where  theorems  have  been  modified  or  ex¬ 
tended. 

3.  General  Penults. 

If  v’e  let  p  denote  tl space  of  ail  drub ability  distri¬ 
bution  functions ,  vie  nay  consider  the  definition  o^  a  mixture 
to  be  a  transformation  of  an  aiement  F  £  ^  ,  relative  to 


?ori 


X  P  , 

be  u  ,  efux  in  f  r c  b; . t  U.  fit ,v  in .  et#X  i st ;.  j  a 
be  desirable  to  have  t|j^  of  sugl 

subset  of  P  .  Robbins  [l^J  proves,  in 
indeed  the  case,  and  vie  ht  el 


ite  r;  -  j  Pa  a.  Ta 

L  t  >ri  it  would 
a  tr,..of crmat ion  be  a 
general,  that  tnis  is 


Theorem  1.  Lqt  $4  =^P(x; <0 :  oi  £,  3mj  be  a  family  of 

n- dimensional  d  B  f  „  1  s  arid  let  G  be  a  d.'h  defined 
in  T01.  Then  the  function  H(x)  =  J  F(x; °OdG(et) 
is  a  distribution  function  in  3*1. 


As  noted  in  the  introduction,  when  a  certain  form  is 
assumed  for  the  underlying  probability  distribution  in  a 
statistical  investigation,  the  idea  embodied  in  definition  1 
is  really  occurring.  Such  as  assumption  amounts  to  speci¬ 
fying  a  mixing  distribution  G  relative  to  a  Pas}  13 y  . 

When  one  assumes  that  the  underlying  distribution  is  normal 
with  mean D ,  and  standard  deviation  <r  ,  one  is  choosing 
from  the  class  of  all  mixing  distributions  a  d.f.  G  which 
concentrates  all  its  mass  at  a  single  point  ({40,<T0)  in  E2 , 
and  we  have 

h(x)  «  J|(^,<r)dG  =  J (^0 , <r0 ) 

;v  nere  is  a  generic  element  from  the  family  of  normal 

d.f.'s.  Theorem  1  assures  us  that  under  more  general  condi¬ 
tions  (i.e.,  more  general  fixing  distributions)  the  closure 
-rty  holds. 


prop- 


•  t -  1 


t  s  any 


11  (O  .  L'  .  >  O-.T 


the  Fourier  integral,  it  is  known  that  tiers  is  a  one-to-one 
correspondence  between  distribution  functions  and  character¬ 
istic  functions. 

We  next  present  some  t'  eoreas  concer  lag  the  structure 
of  tie  characteristic  function,  omerts,  a-d  density  func¬ 
tion  of  a  mixture. 

Theorem  2.  If  H  is  a  G-mixture  of  ^  |  F(x  ;ot)|  and  \jf{  t), 


Proof : 


lu  p  pose  H(x)  =  J  F(x;ot)dG(cL) .  The;,  since 
je^x|£l  we  can  use  theorem  5  from  pLobbins  [l2] 
to  ensure  the  following  steps  are  valid: 


we  can 


iff':  V  )  =  J\J/\  ;«  j 


Theorem 


=  /eltxdx  j  Jf(x;*)  dG(d)j 

JeitxdH(x)  -  \jj[t) 

~co 

'■it  this  shavs  that  H(x)  =  J  F(x;cc)dG(<0  ox  ill 
but  sets  of  measure  zero. 

3.  If  H(x)  =  J*F(x;oOdG(<0  then  a;  y  existing  moment 
of  H  is  a  G-mixture  of  the  fa; ill y  of  momSuts 
(of  tne  same  order)  of  ^  . 


Let  mr  be  the  r££  moment  of  h  and  mr  (d)  the  r— 
moment  of  F(x;ct)  and  assume  mr  exists.  Then 

mr  =  J  xT dH(x)  =  Jxr dx|  J"F(x;<*)dG(d)  j 
=  J*|xrdxF(xjo(.)|dG(oc)  =  J  ir(oL)aG(d  ) . 

Let  H(x)  =  J"f(x  ;  tx.)  dG  (<*)  and  suppose  F(x;<x)  is 
absolutely  continuous.  Let  f(x;o<.)  =  ^ F^( x ; a, )  t 

Then  the  density  function  h(x)  -  JL^(x)  is  given 

0X 


The or ex 


by 


J  f  U;a 


)dG«). 


9 


4 .  I.' :  .  c  i,  iu  ’■  i  LI'  . 

Suppose  o ou dicer  t:  -  o&  e  :r>  the  u&derlvlt  distri¬ 
bution  is  a  mixture  or  two  bin  »  1  1  <i  •  .  ributions .  T.fe  assume 
the  probability  of  success  in  t-  '  first  population  is  p-j_  and 
in  the  second,  p2  and  that  each  population  is  well  mixed 
with  the  other  to  form  the  total  population.  tfe  assume  that 
the  proportion  of  elements  from  the  first  population  is  cL 
where  04*<1.  The  probability  of  success  from  such  a  mix¬ 
ture  is  (*  P]+  ( 1- °0 p2  s=  p;  and  if  n  independent  trials  are 
made ,  we  have 

?r [k  successes]  =  |^J pk( 1-p )n“k 

where  the  distribution  is  again  binomial.  As  will  be  shown 
later,  sucn  a  fixture  is  not  identifiable.  Using  a  sample 
from  this  mixture,  we  could  estimate  the  parameter  p,  but 
not  the  parameters  pp,  p 2,  and  <1 .  The  sampling  sche  ..e  can 
be  ref or  ulated  in  some  cases  and  estimators  constructed  for 
the'  individual  copulation  parameters  (see  Blischhe  [l]  ); 
however,  it  is  not  inuned lately  obvious  how  this  could  be 
done  in  all  cases  cf  mixtures. 

This  leads  us  to  the  study  of  w  at  properties  a  family 
3 i  =jp(x;ot)|  must  possess  to  lead  to  identifiable  mixtures. 

U e  let  D  stand  for  an  Abelian  semigroup  under  addition  and 
use  D(I)  to  mean  t me  integers,  D(I+)  the  positive  integers, 
and  r  and  R  to  denote  the  rationale  and  reals,  respectively. 
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-■  111  )  '  . 


£/=  j  F ( <X  ;  .  *  t  j\ 

<*,  P  £.  D  e  have 


3ia  «tic  • :  :u*  -  e  . 


F(x;«.)  *  F(x;fi)  =  F(x;*+f) 


■  ere  *  denotes  convolution. 

A.ddit  Ively  closed  tatiili*s  of  distributiuli s  occur  '.jn  ite 
frequently  in  applications  iu^  uich  its  tie  liorual,  binomial, 
Poisson,  gaftuoa .  sod  other  fists!  but  ions  have  the  property. 

Of  course,  in  ra.udo*»i  sampii  ■  t  e  in  ort-  _cc  U:s  in  the  fact 
that  the  distribution  function  o+“  the  random  variable 
Z  =  X+Y,  w1  ore  X  aid  Y  are  independent  random  variables,  is 
equal  to  the  convolution  of  to  distribution  functions  of 
X  and  Y. 

Theorem  5.  If  F,  G,  and  H  are  distribution  functions  in  31 
aiid  ^(t),  I p  (t),  or d  \jj{ t)  the  corresponding 
ch.  fen's,  t  en  II (x)  =  F(x)*G(x)  iff  Xp{ t)  = 

\ffl  ( t )  ijfp  ( t ) .  ( dobbins  [l  i]  )  . 

One  of  the  use-  of  theorem  5  is  the  determination  of  families 
which  are  fidditivh.lv  closed.  As  an  example,  ue  consider  the 
family  of  normal  distribution  functions  |?(x;ju,  (f)|  .  The 
corrcoi  ondi-r.'  cla-i  of  c'  aract  -?r ict ic  tVmhtiohs  is 
jeit:f  “  |t2(r2].  Then 

h(,  )  -  P(x;p1,CT1)  •-  P(x;^2,(T2) 
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l^(c)=ei tfa-  jt-fi  o/v  it  (r  _  it(Mi+/^  )-  ~t  (<r1+r22). 

which  is  again  the  bhajv  iteristic  function  of  a  normal  distri¬ 
bution  functio  .  L  P(x;/4-!  ,0"i)*F(x;^,(T2) 

and  the  Glass  of  normal  d.f.'s  is  idditively  closed. 

Teicher  [l^]  determined  that  the  class  of  mixtures  of  a 
one -parameter  family  of  aid  it  ively-cloo-ed  distributions  is 
identifiable,  and  he  gave  conditions  under  wirier.  a  class  of 
scale  or  translation  parameter  mixtures  is  identifiable. 

T7e  summarize  theme  results  in  what  follov/s. 

Theorem  6.  If  in  =  1  -id  D  is  D(I+),  D(r+),  or  1(3+) ,  Lie 


£'iftbl€  . 


|  of  an  addi- 
•.  fj  is  icenti- 


H 


’(xjoOdGU) 


t ively 


closed  fg.’HiLy  |p(x;oc): 


The  class  of  scale 


of  tne  f c 


j  (ns.)  .  (°0 


parameter  ,  ixtures  dr 


Yt  nmj  consists  of  (fixture 
the  civ  t3  of  translation 


Theorem  7. 


Let  F  dr  t.f.  d  m  ,r-m  family  |p(x;=i) 

via  a  seal.  u.nu.  o  c  t.  h  d  (C  +  )  =  0.  If 
the  Fourier  tra  form  of  F(y)  =  F(t->r)  is  not 


identically  zero  in  some  non-dec merate  real 
interval,  the  class  of  cell's  .cm  net  or  mixtures 
is  identifiable. 


L,*l  X 


.  iiet  H(x)=:  <1,  =  J;,. 

istlUi.  F(y)  =  F(  ),  3(h  =  l-ait.-*), 
for  -«><y,  /3  <  «=» 

F*:  G  *  J  ?(.J-P)rG(P)  = 

Jneye-P) d(l-3(e'h)  =  J ?(,:*), iG(«)  =  K(  ). 

aoi4.cc  ,  P'5  G]_  =  F*‘G2  ^  Fv  =  F^Gg  —  H  ( x ) ;  .no  ;L.oo 
F  and  Gi  i  *  1,  2  are  d.f.'s,  ,o  h^vr. ,  jsin.g  11  sorou  5, 

*Af*  ^G2  *  ^F*^G0;  and  sinoe  ( t )  ”  Je±ixdF(x)  is  not 
identically  zero  (except  possibly  on  a  set  of  measure  zero), 
then  -  ^P'q  anci  ^  -  G  4  1-G-,  (e"0  =  I-G2(  '^)  =* 

G-^  ( «* )  —  G^(oc)  r.nd  t1  c  class  of  -c*le  pa  register  fflixtar-  _  it 
ident if iable . 

Theorem  8.  Let  F  be  a  d.f.  which  generates  a  faoi_y 
|p(x;oi)|  via  a  location  change  such  that 
P(C+)  =  0.  If  the  Fourier  transform  of  F(u)  is 

not  identically  zero  in  some  non-den  n„ crate  r  .. 

of 

interval,  f  c  cla 3 sA translation  parameter  air- 
tureS  is  identifiable. 

Proof:  The  proof  is  essentially  the  same  ao  in  theorem 

7.  hote  that  we  assume  the  mixing  distribution 
is  on  th  translation  parameter  only. 

When  we  consider  the  cTj.  js  >f  rixtures  of  a  specific 
family  of  d.f.'s,  we  can  divide  the  class  of  .ixing  dyf.'s, 
gl  ,  into  two  mutually  exclusive  classes.  Let  c.e  pro  t\  ? 
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(X  £ 


- 


i  0 


.‘r..  l  j Uit  in  2  ,  /.ur 
ar  ‘  o-i  3 1  ,-d  <j*j 


-di..  ..  .  •  .  in  $  ,  i .  j  .  , 

yi  ,  /X  _ct  .  t:  v  >  ,  i'-’-u  ^  ^ 

Kow  nup  hud  -  cl  •  <h  '.id  t:.e  Induced  class  of 

H  .  :  'till  ■>>.;.  I  t  G*  £  £  rd  let 

H(x)  -  Jf(x;cl)&G“  (ol)  .  If  f,  ife  in  the  clato  ^  ,  ‘ay 
H(x)  -  F(x;°L“),  ti:t n  the  d,f.  G  g.  ,  which  concentre tea  all 
its  mass  at  o L ,  yields  H(x)  -  J  F(x  joOdG(<=0  =  F(x;«*‘).  But 
this  means  G  =  Gv,  since  'H-  ii  identifiable,  ard  clearly 
ttlis  is  impossible.  3o  ve  V-ivs 


Theorem  9.  Let  ^4  identifiable  with  respect  to  <2*  .  Then, 
■  o  •  '-depenerr  t  '  3  :f'  ire  of  9*  is  nr  in  -  ent 

of  2*  . 


This  remit  ••  .tabliohc^  r  ec-  ssary  cc/*diti  m.  for  idsnti- 
f lability.  If  *.  o'-  find  a  m  '  i.erat  :  il't-r:  of  a  cl  j 

such  t  rut  the  to  ml  tin *_  r.i..i- ur«  3  s  p.^ain  a  •  nbor  of  the 
cl  so,  wr  xvi  r  t:  ol.  ■  ui  .1. lures  is  lot  1  -l-j  tifi.ble. 


Theorem  10. 


Lot  ^  ‘  .  Gi-uini’U-S  of  =  |f(x;°o],  i  =1,2 

Thin,  H1^H2(^=jF(x;oL)d(G1-G2)(CC)if  .and  only  if, 

<2*  i  additively  closed. 


Proof : 


Suppose  Ei*H2  = 


Let  F  =  H1^H2  and 


G  -  G]_*;-G2,  and  suppose  ^  is  yot  additively 
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3  ot  p>.  <: .  »t 

(  ;cL  F(3  ;/*_  )  4  (  ) .  i-  t;  (°t0 )  = 

A,2(^.:  =  :  -,(,:)  =F(XJ%)  fta  ^U). 

lASl(t)  =  eUOlo>  $}2<t)=  elt/8°- 

.  .cl  by  t.  jorc.,;  2  =  0it  (ot0+^o ) .  hence, 

Jf(:  ;oOdG  »  F(:c;oi0+/^)  1  n  t  H(x)=H1-II2(x)  = 

F(x  ;«A  )'•>?(  ^ )  £  F(3  ;<x0+/o)  i'o  clearly  ■  centra- 

■i  ictit  h  ,  ^  't  1  additively  closed. 

■a  1  7oae  Jf  it  *  very  cio  .  ea.  L  l/f(t )  ,  ( t )  , 

ij/gi^),  and  ^(t;OL)  denote  the  d  .  f .  ’a  of  I:,  H-,  ,  h2 »  ’-^d 

F(x;ol) ,  re:!j.cir-f  y,  TI  sing  t~  ore  z  2  n  d  5,  have 


lA(t)  -  Ip  (Dip.  (t)  =  /^(t  ;oOdG1(<t)._[l/r(t^)jG£(p) 
“/ /(A(t;«.+Wdc-1(«.)dG2(P) 

=//lA(t;V)dG1(Y-/5)dG,  (P) 

=  / \p  (t  ;v)dG(v) 


and  this  implies  tnat  h  is  a  G-  =  ^i^Gg -mixture  of 

5*  =  Jf(x;  °o]  . 


Ife  note  that  in  our  statement  of  this  theorem,  US  n\l-i 
to  £ii cur 2  is  ado  it  i\*  sly  closed,  -e  ,  ave  required  that 

1^=Jf(x;  ot)d(G^‘-G2)(^)hbld  for  the  entire  mixing  cay  .no 
S  i  and  far  1  •  .  .  ••tri  ent  conditions  are  no'oecsrury. 
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t  s  f  h  i 


-I!:]. 


stilt  Lk 


'■  r> I  G2 ,  Gr 
<~>i of  ■  ,  t  r  CD-I  '■  •■  1  l  Lor 

G]_- fixture  a  lilt  &,  ip-:.  •r“  of  ^ 

,  (G1^G2)-i.!'  -  ■  -  '  ,  t-ien  #  i  Add  It  I 


5.  Add i lively  Oil  d  erd  Id-  1  i i  •  -  It  &  .tribiition-. . 

tfrsiiuj  of  t’ji  forego  ia-;.  ■  1!:,  ,  -e  ifHl  i  •  t  •  .•  .Vne 

ifdioii  of  tM  ioro  ,t  '...d  rrd  dlUrlbiir.!  .  .  fo±,.  :bitt'/ely 
closed  cl-u3-.  si  .  ■  led  ire  i  ion elf  i  3  hie  . 

I’fs®  Poi  ssoo.  dlltr  ibu  uitjfl  i.  A  •  •  by 

f(x;M  =  £  e“^  2^.  ,  X>0. 

The  ebamet  eristic  function  for  tl  -  Poisson  is 

b'( t)  =  Jeit:i  a-(;)  «  |  eltx  s  X 

Let  tint  ?l  (x ;  \)*P2  (T- » H?  )  =  H(x) ,  \r  •  find,,  filing  ti.  os,,  3, 
that 


,:(’<)=  r  e“^l+>d)  (HA  )  ; 
jr  ki 

which  io  Poisson  -with  i  remoter  X-L+)^ ,  ...d  .  gnee  t  .  •  is*  i  - 

fa  'll  f  i  dditiv  ;ly  I  ;d.  By  :  a,  n  r  ;»  t«*it  - 
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t 


-  E  (g)  ' 


Jr  lid.,  y 

:  a(.  ;oi,p)=f  1 

1  ,  re  p 

rt  to  ot. 

J-“  ff*ji  +  (>nf  j 

:  \ 


H 


_ j _ 

JR'S) 


Tem  set 


*A(t  j  -  -  a — _ 


(1  2it )~ 

Negative 

:  B-(xs-,,)  -  X  (r+k'1)Pr(l-P)  . 

respect  to  r. 

<A<t)  -f_l  --I" 

)elu  J 

Gcrn:.  r. ;  G(x  ;\,r  )=j 

f  \  (X  >r“  •  -X  ,  :  -ot 

L  ftrT 

■p 

[  ■  c 

1: 


I  (*;p,<r)  = 


i 


dx,  with  respect  to 


lA(t)  = 


In  vieT"  of  theorem  5,  we  can  al*to  examine  the  products 
of  characteristic  functions  of  two  members  of  a  given  class 
of  distribution  functions  to  determine  that  the  class  is  not 
additively  closed.  For  example,  in  the  exponential  class 


s0  _Vl _  .  ^2  _  Xl  A2 


and  this  is  not  the 


>2-“  X^2-t2-it(Xi+X2) 


the  characteristic  function  for  the  exponential  with  para¬ 
meter  Using  the  same  argument,  we  see  that  the 

Bernoulli,  geometric,  and  Uniform  clashes  are  not  additively 


closed 


By  using  theorem  6,  we  note  that  since  Xe.D(R+)  the 
Poisson  family  is  identifiable.  dimilo.rlj'- ,  the  bi  xenial, 
chi-square,  gamma ,  negative  binomial,  and  Uauciiy  families 
are  identifiable.  By  using  theorem  9,  we  note  that  if  we 
can  find  a  non-degenerate  mixture  of  a  certain  class  that 
is  again  a  member  of  that  ola*s,  then  Tue  can  conclude  the 
class  is  not  identifiable.  For  example,  if  we  consider  a 
mixture  of  two  Bernoulli  distributions  of  the  following  x^orm 
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.  1  I  c 


,  =  0tB(.  .  +  (l-cOBU;_-:_) 

\jj{l )  =  •-  +  J  +  ( :  -  «.)  ^j2olt+  I-Sp  j 

=  [cO,  +(1-ol)p2J  elt+ou(i_p1)+(i».ou)  (1-P2  ) 
=  pe^+d-p) 


and  H(x)  is  again  Bernoulli  .'lib  p  =  a  :  ±  -r  (l-oi)p2  as  a 
parameter.  Hence,  t'  e  clas.,  of  Bernoulli  »i-*tributionsi  ia 

not  identifiable. 

He  will  now  observe  t’  :.t  tue  property  of  ..dditlvity  |s 
not  :\3ca.2iary  to  e.n’urj  idpiut  i :  lability.  Tie  expo::  ntial 
distribution  is  not  audit ivf ly  closed,  but  in 

F(x;v)  =  j  Ve"V"  dx  =  l-c^v" 

J  o 


V  is  *  scale  pa  ran*  t*r ;  in  id  1 2  iv  [ij  ,  x  :o-a  -  7 

■Shows  t’  at  G(^ ) -mixture  .  jf'  j  ?(x;V)j  ar~  ioo  tillable. 

Since  the  normal  family  is  additivel.y  closed  with  respect 
to  each  parameter  (singly),  we  may  Uov,  cueorem  6  again  to 
conclude  the  family  is  identifiable  for  G(|d)  and  G  (0" ) -mixtures . 
For  a  discussion  of  nixtures  on  both  parameters,  see  Teicner 

0.7] . 

The  foregoing  results  are  summarized  in  t;.  e  following 
table . 
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.'i  fi  UOS'.'RE  A.  .  i  i  'i  L ii. B  :  ■  Y  SUMMARY 


A  V-'i  * 


2k-_i0;i  it  ±i  1 


Qa  x;  is. 
&eo.netric 
A  eg.  Binomial 


Pol-’ a  on 
Unif ora 


Y’,3  M 

I  U,/3) 
U) 


Ti  (r) 

:-.o 

Yee  (_) 
Yos  (H,r) 
Y-o  (>) 

..o 


Uo 


Ye~s> 

Yes 

Ye., 


Ye  9 


A'-J".  .-.'IS 


1.  Tl-  "  bi  r'i'ii ;  1  Y  '  liti  v  i jt  1  .i  l  .  ?  -  ■  t  • 

mixing  di  stribntijn  i  ?  e  .-  -  t.  e  ..  9  - 3ft ir  >*. 

r:  e  "..,.7.  -  :i  lY  i  i  :•  <«.!,  tuo 

district !.■:  t  t  ••  ...  :  m.JIj  tr  u  *  •.  sin^rLiru.  dwvifvtiotL 

::  lv.  .  .) 

3.  For  ;  >•  o:  1  •  it  is  .  .  t  i.  i  7  >9 n  P? . 1 11  v  1 

' .  7  o  .tiff  ble,  7  r  [7  ;] 

Li.  r  ./  -  ii.  . 

3  C;.!-'!'  -9  •  1  ;  "9  111  ' .  1  v  g  ■  9  9-;  U  V1  i  3t  rii'l  t  io  tt 

2..1C  i  .  !'»  Z  -  li  •-■;•'•  •  L_r;,  -fy  -  j  . 

i  iti'  H(y)  -  J F(x;ot)-lS(ot)  i  :  9  .9 

W.ft?  if  5  to  •  fj  It*  9J  ...  3 


t  r'b  i- 


l  . 


G  *  £ 


G(oi)  =  \  jr  -  <^-*2 


,  i  oi 


The  ..lixtur.  r  jh.  .  .••->  to  a  cl-.  .  ^ *  |f(x;  <*)|  ie 

H(x)  =  i  F(x;41)  +  |  F(x;^)  , 


T.vTa  first  eonai-'-r  tfc«a  case  of  f  ‘  a  t  linear  '  1  t  u'  i.e,  , 

H(x)  =•  £  ai  F(x;cC^) .  Clearly,  r*  is  amin  a  distr :  jution 

i=  1 

function;  and  letting  \jj{ t;oL)  b  t.x  characteristic  func¬ 
tion  for  F('i;ci),  vx  --.vo 

lA(t)  -  /l/(t  i«)uS(<c)=  £  at 

as  the  CiUiao tori -bio  function  of  Uisn,  the  o neats 

of  H  are  giver  a  .  functions  of  t  it  .aoaeuts  of  F(x jol)  by 


Xi  *1  *r^i) 


wfih-re  ,ur(oti)  is 


rill  ono.rb  • "  i?(x;a^).  I'¬ 

ll 


fli.1T  d 


i  rect 

.  :  *  t  -  cl  ,  eC  A  -  a  ±-,„  J0.U6  it 

a-  -  orjj  U:  .ro.^rt;  j 5. 


G  &  £  =>  lj/(t  )  = 

Jc-it-  i3(-jt 

)  =  E 

k=] 

o  ->  hih'r 
nk- 

By  to  orern  5  if  G-j_,  G2  ^  Jo 

,  C’  i  .  m 

G1;«G2 

fill  have  a 

charr ct jrist ic  function  of 

tbs  for  it 

y/(t)=  (|  .  )( 

k'~-  "■■) 

=  l 

k=l 

E 

5=1  C3 

where  r^.,  =  p^u..  e  ■  = 

+ 

But  this  is  preci  cl;,  tu-;  form  vf  c  r-cteri.tic  fi.n.ct ior  ; 
of  dist ribut iorr  in  £  .  31  ear 3. y ,  (G^-'Gg  J^Gj  =  ^ 

and  G-^-Gg  =  ®2*G1*  to  considerin'  X  as  ar  algebraic 
system  with  convolution  s  t  i  binary  composition.  defined 
in  c£,  ,  we  have 

Theorem  12.  Under  tfie  operation  of  convolution,  is  an 
Ah el law  eeni-group. 

Jo  x<  0 

Ue  also  note  that  I(x) =  \  is  of  the  requir'd  form 

1^1  Oix 

to  he  a  distribution  function  in  £  .  I(x)  has  cliaracteri  tic 
fu  i ct ion 

l/nt)  =  Jolt::  41  (is)  =  l-elt0  =  1 
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:(i  ) 


,  '  cC  J  i  1 

X  l*  . 

7  .  J.L  '  *  -  J  ■  .  J  /•  •  1 1-  ■  -  ?-*  t  Jui  .  Jta  f  :  .  -  _  T)"l  •  1  . 

Ir  i  =  0<h  it  la  ct:  -  .njc 

s  o*ria»»i  '  •  -  ij;  '•  ,  ,•  •  tb?  J  i-rS'bu 


B  .  £ 1  tii  ;n?  o:  rv  •  '  xi 

a’jl-',  :  ■  ■  •  r  *  L  —  ft  jQ  *.  ;.p  SG  0 ' 1,7  ,  1H 

aerai/i  -  -«0  Carol  i.**  t  :  *i>-  1  '  *  Fur  :  ..••■.  :  c  , 

if  Xlf  i  =  ■  ,  -  ,  .  ,  u  -  -  1*  iv  ;i  tr  1  J 

i:  court.  .  -  l  Gr.  •  ,  ii  i  )  > 

~!I1  =  X]_+Xp+.  .  ,+Xn  be  x  x  ut  i  jordlbp  to 

n  n 

£  f  -  E<r  >• 


Definition  i  fzcll  •  .f  .  ir  ■  •• '  ■  .  f  -  -  - 

=  j?(  ;  *)]  U  0  i  5  -  ;  r  :  '  if  F(y ;  cl)*F(*  ; ^)  = 

F(z;gU,p)). 


’fe  12 ‘>te  fc'x.  f  i  •  L?  1  ■>  ■  rv..  . ...  •  t  .  of  t •:»’  j ' .* 

3 rt y  of  nM  r  («,/*)  =  ot+  £  , 


t  ■  f  'llo  mi/  .  -  ..  v  . 

T  »ns  i  13.  x  t  &  i 


H 


>jU  ti 


,  n 


-  I  .  T 


■Lj  «  •  -  Ln*Ir  by  \jf(t), 

*  oc)  characteristic 

functions  of  H,  H- ,  f.:  ,  s  d  P(x;  a) .  By  theorei 


^l(t)  =  Jl/Z'ft ;  ot)  dLx  (d  )  l^2  (t)  =  ;a)dL2(^) 


and  by  tbeor  r  5 

l/f( t)»  0i(t)  *  l/r2(t)=  /*//( tjcOdL-LfcL)  .  f{l/(t;*)dX2W 

-  f  fi/nticL+n&L^eL)  iLrjt) 

•j Jl//( t  JY)dL1(y-A)dL2(P) 

=  J ^(t  ;V)dL(Y) 

aod  t  i  ir^Iie'5  —  J^FdL.  But  L  —  L-^Lg  and 

diuce  X  ij  oho  i  u  ’er  the  o  :  rot  ion  of  co> 
vo  la  t ...  j„  ,  o;  1  &  ‘H-  . 


As  an  example  Of  t  '•  -  for.-  :> la|  tdeoro«r»,  Vu :  ‘‘O  ;e  ve  v03*». 
o  Lrid^riylcc  lirfr-L  utior  of  a  popul  fcion.  to  M  a  fixture 
of  tc' ; o  norm]  -ii  -trl yutianv*  f  m, 

:■(:  )=  01  (H  ,(T1")  +  (1-01)2:  (H  ,<r-)  «*< 

is  thr  d.f .  iu.‘  •0--  e  h  ■.  •  .  tuaplS  of  ;  La  „  a..td  t  to 
^  -  .1*  :  .  h  >f  i  =  -  +  _  +  . >  --  t-  at  3 


i 

I  ■  i  i  l^-:(o)  = 

^-.(tj+d-oL)^  (i;  (  )  •'  -•  'T*  :t\c  . 

ton  of  -(f'i, 0~i2),  .  -  ,  i.  U  i  .  .  ,  t-  ."t  for 

the  c  ^  re.ct :  ri  .t '  o  ration  a."  ?gr  l/^t), 

iA(t)  =  [^/%(t)]n=  [ot^ct  +  d-^)^(t)] 

=  t  (;)  oc'^C- )(!-«. 5-  lA  “  (t) 

=  £  p  xff\{  )\jj “‘(t)  ••  .  -re 

A-  =  (  )  ot  (  •  4)  •  "  ,  .  •  •  •  »  n . 

The  4l  trU-u.tiou  f  tie  o  ....  to  (t  )  t& 

-f  (vi"-c  )H. ,  O’  +(n-k)^T_)  =  ,  1,  ...» 

Hence,  F-^  —  + /£, '  +  ...+y?n  ,  \±  e  If.  t*  ttie  i.or.n  1  il.'o- 

tribution  fmrefiof.  T  ••  h'.r'i]  t  i  :  ,>ilv  •  xt c  Cef.  to  tM  - 

qubq  where  t  distnbutio:?  fu  e*t  i .  o  i l+titrft 

qJT  inrc  t  :  t  ■  '  'tr ‘h t  io --  by  t he  Mxltiao*al»l 


taeor  0  3 


of 

tlon-s  J'-1-  l,v  ftiit-'O  3 ;  i  i  -  t 

A.arl,  [8]  i'  ’ 

t io:..  of  i-  ■  ■  t  .  r 

iiixtu  r?  cl  z 


L  1- 


•'  0  i ;  .  J  L- tf.od 


cion  ] 


5f  3 ::  t  i  m  - 


tat:,  .) 


ill. 


ati-.f  d-2  3 jived 


-  qn  .  L  tt  i  -  t 


1=1, 


■re  have  '  ( ;  }  =  +  (l-ol)f2(_.)  , 

and  ,/v  sr  )  =  jl  i(  h  )  '  ,  t  , 

tion  for  a  . i a '  ,  It-  b;  -Io 3  . 


Io.  -  =  £  jcxf^nj  +  (1  «.)!.(.  .)[ 


cro ,  ft  r  et 


r _ i  f  hta)-h(a) 

=i  «J,1Ui)  +  (l-a}f2(:iiy 


( 


L 


«nr 


( .,) 
'cTT r* 


T 


(3) 


3i 

2)03 


A 


(5  t) 

urr t^tt 


(45 


>  ^  i 

S>3  ' 


z 


<1  '  ( 

5T:'  r  '.~)+riraLyf.;T;;rT  “ 


(5) 


^ler  I, 

^(Tr 


A 


(l-°Q^~r-  •  (  ■  ) 

°c :  ■  i  )VCi- *7^7(7  J 


c 


lHieis  unci  Cj;:ji;er3  J-’  t  er.cr .  v  : :  .  f :  (^3  -  ..  f  (f^) 
iiirolva  the  4  it:?  ^,<5^,  ,  OV,  r 

in  c.ch  of  t  .  -:j  icitiju  ,  t  ...  id  :\f  !•:  of  f  .  i  .  lu-j 

tion.  for  tl  e  alloy  .  ».t  of  s  ,  .i  t  •  5  t  ;  for  i  &  =  ot(  .), 

=  ^(x),  ?  =  ^  (  ) ,  5-3=  O'  (  '),  Tr  =  0-2(.  ) 

X  =  (xlf  X2,  .  •),  r  ftlv  '  CO;..  •  I  it. 

ireedlis«8f  to  •'„,!  .  v 0"  ‘  - 1  v.r-  00  'oloj-  is  lr 
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